Exact Learning and Data Compression with a Local Asymmetrically Weighted Metric
نویسنده
چکیده
This paper is concerned with a local asym-metric weighting scheme for the nearest neighbor classiication algorithm and a learning procedure, based on reinforcement, for computing the weights. Theoretical results show that this context dependent metric can learn exactly certain classes of concepts storing fewer examples that those required by the Euclidean metric. Moreover, computer experiments show that the proposed metric, storing a randomly chosen small percentage of the training set, can still outperform the standard nearest neighbor algorithm in terms of accuracy and can obtain almost the same accuracy as the k-NN algorithm. The drastic reduction of the stored examples results in a great speed up of performance at query time.
منابع مشابه
Nearest Neighbor Classiication with a Local Asymmetrically Weighted Metric
This paper introduces a new local asymmetric weighting scheme for the nearest neighbor classiication algorithm. It is shown both with theoretical arguments and computer experiments that good compression rates can be achieved outperforming the accuracy of the standard nearest neighbor classiication algorithm and obtaining almost the same accuracy as the k-NN algorithm with k optimised in each da...
متن کاملAdvanced Metrics for Class-Driven Similarity Search
This paper presents two metrics for the Nearest Neighbor Classifier that share the property of being adapted, i.e. learned, on a set of data. Both metrics can be used for similarity search when the retrieval critically depends on a symbolic target feature. The first one is called Local Asymmetrically Weighted Similarity Metric (LASM) and exploits reinforcement learning techniques for the comput...
متن کاملیادگیری نیمه نظارتی کرنل مرکب با استفاده از تکنیکهای یادگیری معیار فاصله
Distance metric has a key role in many machine learning and computer vision algorithms so that choosing an appropriate distance metric has a direct effect on the performance of such algorithms. Recently, distance metric learning using labeled data or other available supervisory information has become a very active research area in machine learning applications. Studies in this area have shown t...
متن کاملA Minimum Risk Metric for Nearest Neighbor Classification
nale. Retrieval in a prototype-based case library: A case study in diabetes therapy revision. CH97] C. Cardie and N. Howe. Improving minority class prediction using case-speciic feature weight. CS93] Scott Cost and Steven Salzberg. A weighted nearest neighbor algorithm for learning with symbolic features. DP97] Pedro Domingos and Michael Pazzani. On the optimality of the simple bayesian clas-si...
متن کاملComposite Kernel Optimization in Semi-Supervised Metric
Machine-learning solutions to classification, clustering and matching problems critically depend on the adopted metric, which in the past was selected heuristically. In the last decade, it has been demonstrated that an appropriate metric can be learnt from data, resulting in superior performance as compared with traditional metrics. This has recently stimulated a considerable interest in the to...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007